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Detailed Action 

1 . This office action is in response to an AMENDMENT entered November 
29, 2006 for the patent application 10/725378 filed on December 3. 2003. 

2. The First Office Action of August 31 , 2006 is fully incorporated into this 
Final Office Action by reference. 



Status of Claims 

3. Claims 1-33 are pending. 



35 use § 101 

4. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, 
manufacture, or composition of matter, or any new and useful 
improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 1-33 are rejected under 35 U.S.C. 101 for nonstatutory subject 
matter. The computer system must set forth a practical application of that § 1 01 
judicial exception to produce a real-world result. Benson, 409 U.S. at 71-72, 175 
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USPQ at 676-77. The invention is ineligible because it has not been limited to a 
substantial practical application . An inductive learning method by itself has no 
practical application. The result has to be a practical application. Please see 
the interim guidelines for examination of patent applications for patent subject 
matter eligibility published November 22, 2005 in the official gazette. 

In determining whether the claim is for a "practical application," the focus 
is not on whether the steps taken to achieve a particular result are useful, 
tangible and concrete, but rather that the final result achieved by the claimed 
invention is "useful, tangible and concrete." If the claim is directed to a practical 
application of the § 101 judicial exception producing a result tied to. the physical 
world that does not preempt the judicial exception, then the claim meets the 
statutory requirement of 35 U.S.C. § 101. Phrases such as Inductive learning 
model', 'processing an inductive learning model' and 'a system to process an 
inductive learning model' all generate a inductive learning model but there is no 
stated real world practical application for such a device. 

The invention must be for a practical application and either: 

1) specify transforming (physical thing) or 

2) have the FINAL RESULT (not the steps) achieve or produce a 
useful (specific, substantial, AND credible), 

concrete (substantially repeatable/ non-unpredictable), AND 
tangible (real world/ non-abstract) result. 

A claim that is so broad that it reads on both statutory and non-statutory subject 
matter, must be amended, and if the specification discloses a practical 
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application but the claim is broader than the disclosure such that it does not 
require the practical application, then the claim must be amended . 

Claims that recites a method or system that computes a inductive 
algorithm which solely calculates a mathematical response without a purpose or 
function is not statutory. 



Claim Rejections - 35 USC § 102 



The following is a quotation of the appropriate paragraphs of 35 

U.S.C. 102 that form the basis for the rejections under this section made in this 

Office action: 

A person shall be entitled to a patent unless - 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

Claims 1-33 are rejected under 35 U.S.C. 102(a) (hereinafter referred to 
as Fan) being anticipated by Fan, 'Progressive Modeling'. 



Claim 1 

Fan anticipates dividing said dataset into a plurality of subsets of data 
(Fan, pi 64, C1:38 through C2:9); and developing an estimated learning model 
for said dataset by developing a learning model for a first subset of said plurality 
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of subsets. (Fan, p163, C2:11-16; 'Learning moder of applicant is equivalent to 
'progressive modeling' of Fan.) 

Claim 2 

Fan anticipates progressively forming an ensemble model of said dataset 
by sequentially developing a learning model for each of a successive one of said 
plurality of subsets (Fan, abstract, 'Learning model' of applicant is equivalent to 
'learning algorithm' of Fan.), until a desired indication of termination has been 
reached. (Fan, p1 65, C2:31 -41 ) 

Claim 3 

Fan anticipates developing at least one of a current accuracy and an 
estimated final accuracy, said current accuracy comprising an accuracy of said 
learning model for said first subset, said estimated final accuracy comprising an 
estimated accuracy of said estimated learning model for said dataset. (Fan, 1163, 
C2:16 through p164, C1:13; 'First subset' of applicant is this example (due to 
progressive modeling) is 'intermediate models' of Fan.) 

Claim 4 

Fan anticipates developing at least one of a current accuracy and an 
estimated final accuracy, said current accuracy comprising an accuracy of said 
learning model for said subset being currently developed, said estimated final 
accuracy comprising an estimated accuracy of said ensemble model of said 
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dataset. (Fan, 1163, C2:16 through p164, C1:13; 'Subsets being currently 
developed' of applicant is equivalent to 'intermediate models' of Fan.) 

Claim 5 

Fan anticipates developing an estimated training time to complete 
development of said ensemble model. (Fan, p1 66, CI : 1 0-1 3) 

Claim 6 

Fan anticipates each said example in said dataset carries a benefit and 
said accuracy comprises an overall accuracy that reflects an estimated total 
amount of reward from said benefits. (Fan, p163, C2:16 through p164, C1:13) 

Claim 7 

Fan anticipates said benefit is not equal for all said examples, said 
learning comprising a cost-sensitive learning, and said accur&cy comprises an 
overall accuracy that reflects an estimated total amount of reward from said 
benefits in units of money. (Fan, p163, C2:16 through p164, CI :13; 'Units of 
money' of applicant is equivalent to 'dollar amounts' of Fan.) 

Claim 8 

Fan anticipates a database divider for dividing said dataset into N subsets 
of data (Fan, p164, C1:38 through C2:9); and a base classifier calculator for 
developing a learning model for data in a first subset of said N subsets. (Fan, 
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p163, C2:11-16, abstract; 'Learning moder of applicant is equivalent to 
'progressive modeling' of Fan. 'Base classifier calculator' of applicant is 
equivalent to 'learning algoritlim' of Fan.) 

Claim 9 

Fan anticipates an ensemble calculator for progressively developing an 
ensemble model of said database of examples by successively integrating a 
base classifier from successive subsets of said N subsets. (Fan, pi 66, algorithm 
1 ; 'Ensemble calculator' of applicant is equivalent to the outer loop of the 
algorithm 1 which begins with 'partition S into K disjoint subsets'. This outer loop 
develops the 'ensemble model' with each additional Si.) 

Claim 10 

Fan anticipates a memory interface to retrieve data from said database 
and to store data as said inductive learning model is progressively developed 
(Fan, pi 63, Figure 1; Illustrates a display of remaining training time and accuracy 
which is equivalent to a 'learning model' being developed over time.); and a 
graphic user interface to allow a user to selectively enter parameters, to control 
the progressive development of said ensemble model, and to view results of said 
progressive development. (Fan, pi 64, C1:26-30 and pi 69, C2:17-34; 'Allow a 
user to selectively enter parameters' of applicant is implied by 'users have full 
control over the learning process' and 'user can easily experiment with different 
algorithms' of Fan.) 



Application/Control Number: 10/725,378 
Art Unit: 2129 



Page 8 



Claim 11 

Fan anticipates a memory containing one or more of a plurality of 
segments of said example data (Fan, p164, C1:38 through C2:9r 'Segments of 
said example data' of applicant is equivalent to 'subset' of Fan.), wherein each 
said segment of example data comprises data for calculating a base classifier for 
an ensemble model of said dataset; a base classifier calculator for developing a 
learning model for data in one of said N segments (Fan, abstract; 'Base classifier 
calculator' of applicant is equivalent to learning algorithm' of Fan.); an ensemble 
calculator for progressively developing an ensemble model of said database of 
examples by successively integrating a base classifier from successive ones of 
said N segments (Fan, p166, algorithm 1; 'Ensemble calculator' of applicant is 
equivalent to the outer loop of the algorithm 1 which begins with 'partition S into 
K disjoint subsets'. This outer loop develops the 'ensemble model' with each 
additional Sj.); a memory interface to retrieve data from said database and to 
store data as said inductive learning model is progressively developed (Fan, 
p163, Figure 1; Illustrates a display of remaining training time and accuracy 
which is equivalent to a 'learning model' being developed over time.); and a 
graphic user interface to allow a user to at least one of enter parameters, to 
control the progressive development of said ensemble model, and at least one of 
display and printout results of said progressive development. (Fan, p164, C1:26- 
30 and pi 69, C2: 17-34; 'Allow a user to selectively enter parameters' of applicant 



Application/Control Number: 10/725,378 Page 9 

Art Unit: 2129 

is implied by 'users have full control over the learning process' and 'user can 
easily experiment with different algorithms' of Fan.) 

Claim 12 

Fan anticipates providing a database of example data to be used to 
process an inductive learning model for said example data, wherein said 
inductive learning model is derivable by dividing said example data into N 
segments and using at least one of said N segments of example data to derive a 
base classifier model (Fan, pi 64, C1:38 through C2:9; 'Segments of said 
example data' of applicant is equivalent to 'subset' of Fan.); receiving said 
database of example data and executing said method of deriving said inductive 
learning model (Fan, p163, 02:11-16, p164, C1:38 through C2:9; 'Learning 
model' of applicant is equivalent to 'progressive modeling' of Fan. 'Example data' 
of applicant is equivalent to 'subset' of Fan.); providing an inductive learning 
model as derived (Fan, p163, C1:1 through C2:10); executing an application of 
an inductive learning model as derived; and receiving a result of said executing 
said application, (Fan, pi 63, Figure 1; 'Executing' and 'receiving a result' of 
applicant is equivalent to the output display of Figure 1 . of Fan.) 

Claim 13 

Fan anticipates dividing said dataset into N subsets of data (Fan, pi 64, 
C1 :38 through C2:9); and developing an estimated learning model for said 
dataset by developing a learning model for a first subset of said N subsets. (Fan, 
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pi 63, C2:11-16; 'Learning moder of applicant is equivalent to 'progressive 
modeling' of Fan.) 

Claim 14 

Fan anticipates dividing said dataset into N subsets of data (Fan, pi 64, 
CI :38 through C2:9); and developing an estimated learning model for said 
dataset by developing a learning model for a first subset of said N subsets. (Fan, 
p163, C2:11-16; 'Learning model' of applicant is equivalent to 'progressive 
modeling' of Fan.) 

Claim 15 

Fan anticipates progressively forming an ensemble model of said dataset 
by sequentially developing a learning model for each of a successive one of said 
N subsets, until a desired indication of termination has been reached. (Fan, 
pi 66, algorithm 1; 'Ensemble calculator' of applicant is equivalent to the outer 
loop of the algorithm 1 which begins with 'partition S into K disjoint subsets'. This 
outer loop develops the 'ensemble model' with each additional S|.) 

Claim 16 

Fan anticipates developing at least one of a current accuracy and an 
estimated final accuracy, said current accuracy comprising an accuracy of said 
learning model for said subset being currently developed, said estimated final 
accuracy comprising an estimated accuracy of said ensemble model of said 
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dataset. (Fan, 1163, C2:16 through p164, C1:13; 'Subsets being currently 
developed' of applicant is equivalent to 'intermediate models' of Fan.) 

Claim 17 

Fan anticipates developing an estimated training time to complete 
development of said ensemble model. (Fan, p166, C1:10-13) 

Claim 18 

Fan anticipates an overall accuracy that reflects an estimated total amount 
of reward from said benefits. (Fan, p163, C2:16 through p164, C1:13) 

Claim 19 

Fan anticipates said benefit is not equal for all said examples, said 
learning comprising a cost-sensitive learning, and said accuracy comprises an 
overall accuracy that reflects an estimated total amount of reward from said 
benefits in predetermined units. (Fan, pi 63, C2: 16 through pi 64, CI: 13; 
'Predetermined units' of applicant is equivalent to 'dollar amounts' of Fan.) 

Claim 20 

Fan anticipates dividing said dataset into N subsets of data (Fan, pi 64, 
C1:38 through C2:9); and developing an estimated learning model for said 
dataset by developing a learning model for a first subset of said N subsets. (Fan, 
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pi 63, C2:11-16; 'Learning moder of applicant is equivalent to 'progressive 
modeling' of Fan.) 

Claim 21 

Fan anticipates calculating an estimated accuracy for said leaning model. 
(Fan, p163, C2:17 through p164, C1:13) 

Claim 22 

Fan anticipates calculating a remaining training time. (Fan, pi 66, C1:10- 

13) 

Claim 23 

Fan anticipates progressively, and stepwise (Fan, p166, algorithm. 1; 
Progressive and stepwise' of applicant is illustrated by the outcome of the 'while' 
loop of Fan.), forming an ensemble model of said dataset by sequentially using 
additional said subsets to develop an additional learning model for said subset 
(Fan, p166, algorithm 1 ; 'Additional said subsets' of applicant is equivalent to 
'partition S into K subsets' of Fan.) and incorporating each said additional 
learning model into an aggregate model to form said ensemble model, wherein 
said progressive and stepwise forming can be terminated prior to developing an 
additional learning model for all of said N subsets. (Fan, abstract, 'Terminated 
prior to developing an additional learning' of applicant is equivalent to 'user can 
terminate training prior to completion' of Fan.) 
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Claim 24 

Fan anticipates said examples carry potentially different benefits, said 
method further comprising: calculating an estimation of an accumulated benefit 
for said learning model. (Fan, p163, C2:16 through p164, C1:13; 'Accumulated 
benefit' of applicant is equivalent to 'benefit' of Fan.) 

Claim 25 

Fan anticipates for a dataset comprising a plurality of elements (Fan, 
pi 64, CI :38 through C2:9; 'Plurality of elements' of applicant is. equivalent to 
'subsets S] of Fan.), each said element comprising a feature vector (Fan, pi 66, 
C2:14 through p167 C1:10; 'Feature vector' of applicant is equivalent to 
'datasets' of Fan.), said dataset further comprising a true class label for at least a 
portion of said plurality of elements, said true class labels allowing said dataset to 
be characterized as having a plurality of classes, dividing at least a part of said 
portion of said plurality of elements having said true class label into N segments 
of elements; and learning a model for elements in at least one of said N 
segments, as an estimate for a model for all of said dataset. (Fan, p166, C2:14 
through pi 67 CI :10; True class' of applicant is equivalent if the feature is true or 
not of Fan. For example Fan illustrates 2 different elements which have a 'true' 
class. They are 'actual donate' and 'actual fraud'.) 



Claim 26 
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Fan anticipates using a second part of said portion of said plurality of 
elements having said true class label as a validation set for said model. (Fan, 
p164, C1 :38 to C2:9; Validation set' of applicant is equivalent to Validation set 

Sv'ofFan.) 

Claim 27 

Fan anticipates using said validation set to calculate a predicted accuracy 
for said model. (Fan, p165, C1:4-12i Fan illustrates an equation for determining 
probability which is equivalent to 'predicted accuracy' of applicant.) 

Claim 28 

Fan anticipates calculating an estimated training time for learning a model 
based on a remainder of said N segments. (Fan, p166, C1:10-13) 

Claim 29 

Fan anticipates establishing a benefit matrix associated with said plurality 
of classes, said benefit matrix defining a benefit for each said element in said 
dataset as applicable for each said class. (Fan, p166, C2: 14-34) 

Claim 30 

Fan anticipates using a validation dataset to measure a validation of said 
model; and calculating an aggregate benefit for said model, as based on said 
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validation dataset. (Fan, pi 69, C2:1-16; 'Aggregate benefit' of applicant is 
equivalent to 'total benefit' of Fan.) 

Claim 31 

Fan anticipates progressively developing an ensemble model by 
successively learning a model for elements in one of a remaining said N 
segments, wherein said progressively developing said ensemble model is 
terminable at any stage. (Fan, pi 66, algorithm 1 and abstract; 'Ensemble 
calculator' of applicant is equivalent to the outer loop of the algorithm 1 which 
begins with 'partition S into K disjoint subsets'. This outer loop develops the 
'ensemble model' with each additional S,. 'Terminable at any stage' of applicant 
is equivalent to 'user can terminate prior to completion' of Fan.) 

Claim 32 

Fan anticipates calculating at least one of an accuracy and a remaining 
training time for said ensemble model. (Fan, pi 63, Figure 1.) 

Claim 33 

Fan anticipates entering a threshold for at least one of said accuracy and 
said remaining training time; and automatically terminating said progressively 
developing said ensemble model whenever said threshold is exceeded. (Fan, 
p166, 2:1-13; 'Threshold' of applicant is equivalent to 'upper and lower bounds' of 

Fan.) 
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Response to Arguments 

5. Applicant's arguments filed on November 29, 2006 for claims 1-33 have 
been fully considered but are not persuasive. 



6. In reference to the Applicant's argument: 

Claims 1-33 stand rejected under 35 U.S.C. §101 as allegedly directed to 

non-statutory subject matter. 

Applicants are not quite certain what exactly the Examiner is attempting to 
assert in this rejection. Hov\^ever, in an attempt to expedite prosecution, 
Applicants submit the following responses. 

Relative to the examiner's characterization that an '...inductive learning 
method by itself has no practical application', applicants submit that the present 
invention provides a method that greatly reduces the amount of time and cost to 
develop a learning model for a large database. Moreover, as explained in lines 
1-3 of page 2, the non-limiting applications for the types of learning models that 
the present invention is directed toward include: fraud detection, intrusion 
detection, charity donation, security and exchange, loan approval, animation, car 
design, and many more. 

Because of these very real-world applications, the present invention is 
clearly directed toward practical applications. It is noted that statutory subject 
matter is a question relative to the invention as a whole, including the description 
in the specification. 

On page 3 of the Office Action the examiner alleges that the claims are 
overly broad because the examiner considers that the claims are broader than 
the disclosure, thereby providing, as best understood, that the claimed invention 
therefore lacks practical application. Applicants respectfully disagree with this 
position, since the present invention should not be considered as a practical 
application only if limited to those examples such as fraud detection, etc., 
exemplarity listed in the specification. The result of the present invention is its 
method of providing an inductive learning model in much shorter time and does 
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not reside in a listing of the types of specific problems for which these types of 
inductive learning models can be applied. 

In response to this statement, as best understood by applicants and taking 
independent claim 1 as an example, applicants submit that the purpose of the 
claimed invention is clearly described in the claim itself as providing an inductive 
learning model indicative of the entire dataset by providing a model for only a 
subset of the dataset. 

Applicants further submit that the implication in the rejection, that claim 1 
'...computes a[n] inductive algorithm which solely calculates a mathematical 
response without a purpose of function...' is incorrect. This claim, as typical of all 
independent claims, does not recite an inductive algorithm. Rather, the claim is 
clearly describing a process wherein a model is developed for the entire dataset 
by developing a model for a subset of the data.^ This shortening of the model 
development allows the user to determine, within a short time and at much less 
cost than conventional methods, whether it is desirable to spend the time and 
effort to develop a model for the entire dataset. 

If the estimated accuracy is acceptable, the use of the dataset can 
proceed without the extensive testing of conventional methods. This reduction in 
time and expense clearly provides the practical application of the present 
invention. 

In view of the foregoing, the examiner is respectfully requested to 
reconsider and withdraw this rejection. 

Examiner's response: 

Applicant states that the invention provides 'reduces the amount of time 
and cost to develop a learning model for a large database' is a practical 
application. Examiner agrees. The problem is this is not stated within the 
independent claims. If amended claims were to incorporate something similar 
to 'reduces the amount of time and cost to develop a learning model for a large 

database', this seems it would overcome the 35 U.S.C. §101 rejection. 



7. In reference to the Applicant's argument: 

The examiner alleges that applicant's own publication dated December, 
2002 anticipates the present invention. 
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In response, applicants first submit that the IEEE publication in December, 
2002, relates to a conference in Japan, held on December 9-12, as indicated by 
the attachment conference announcement. Therefore, to the extend that the 
examiner relies upon this document, it has to be considered as effective on 
December 9, 2002 and would be disqualified as a prior art reference against the 
present invention because the December 2, 2002, filing data of the present 
application precedes the one-year protection period for using an inventor's own 
publication against himself. 

Second, applicant's submit that the present invention also includes 
aspects beyond those presented in the December 9-12 conference. Therefore, 
even if this document were qualified as a prior art reference, applicant submits 
that there are elements of the claimed invention that are not taught or suggested 
by this earlier publication. 

Therefore, the examiner is respectfully requested to withdraw this 
rejection. 

Examiner's response: 

The Examiner acknowledges the art is within the one year grace period of 
the filing date. The problem arises is that the inventive entity is not the same. 
Authors Shaw-hwa Lo and Salvatore Stolfo are not listed as inventors. 
Additionally both Shaw-hwa Lo and Salvatore Stolfo are affiliated with Columbia 
University and not International Business Machine. Therefore the art Progressive 
Modeling' is valid to use. 



Examination Considerations 
8. The claims and only the claims form the metes and bounds of the 
invention. "Office personnel are to give the claims their broadest reasonable 
interpretation in light of the supporting disclosure. In re Morris, ^27 F.3d 1048, 
1054-55, 44USPQ2d 1023, 1027-28 (Fed. Cir. 1997). Limitations appearing in 
the specification but not recited in the claim are not read into the claim. In re 
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^ Prater, 415 F.2d. 1393, 1404-05, 162 USPQ 541, 550-551 (CCPA 1969)" (MPEP 
p 2100-8, c 2, 1 45-48; p 2100-9, c 1, 1 1-4). The Examiner has the full latitude to 
interpret each claim in the broadest reasonable sense. Examiner will reference 
prior art using terminology familiar to one of ordinary skill in the art. Such an 
approach is broad in concept and can be either explicit or implicit in meaning. 

9. Examiner's Notes are provided to assist the applicant to better understand 
the nature of the prior art, application of such prior art and, as appropriate, to 
further indicate other prior art that maybe applied in other office actions. Such 
comments are entirely consistent with the intent and sprit of compact 
prosecution. However, and unless othenA/ise stated, the Examiner's Notes are 
not prior art but link to prior art that one of ordinary skill in the art would find 
inherently appropriate. 

10. Examiner's Opinion: Paragraphs 8 and 9 apply. The Examiner has full 
latitude to interpret each claim in the broadest reasonable sense. 

Conclusion 

1 1 . Applicant's amendment necessitated the new ground(s) of rejection 
presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. 

See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

12. Claims 1-33 are rejected. 

Correspondence Information 

1 3. Any inquiry concerning this information or related to the subject disclosure 
should be directed to the Examiner Peter Coughlan, whose telephone number is 
(571 ) 272-5990. The Examiner can be reached on Monday through Friday from 
7:15 a.m. to 3:45 p.m.. 

If attempts to reach the Examiner by telephone are unsuccessful, the 
Examiner's supervisor David Vincent can be reached at (571) 272-3080. Any 
response to this office action should be mailed to: 
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Commissioner of Patents and Trademarks, 
Washington, D. C. 20231; 
Hand delivered to: 
Receptionist, 

Customer Service Windov\/, 
Randolph Building, 
401 Dulany Street, 
Alexandria, Virginia 22313, 

(located on the first floor of the south side of the Randolph Building); 
or faxed to: 

(571 ) 273-8300 (for formal communications intended for entry.) 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for unpublished applications is available through Private PAIR only. For more 
information about the PAIR system, see http://pair-direct.uspto.aov . Should you 
have any questions on access to Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll free). 





Peter Coughlan 



1/19/2007 



